A METHOD OF WATERMARKING A VIDEO SIGNAL, A SYSTEM AND A 
DATA MEDIUM FOR IMPLEMENTING SAID METHOD, A METHOD OF 
EXTRACTING THE WATERMARKING FROM A VIDEO SIGNAL, AND A 
SYSTEM FOR IMPLEMENTING SAID METHOD 
5 FIELD OF THE INVENTION 

The present invention relates to a method of 
watermarking a video signal, a corresponding system, and 
a computer readable data medium for storing a signal 
watermarked by this method. It also relates to a method 

10 of extracting the watermarking from a video signal and a 
system for implementing this method. 

To be more precise, the invention relates to a 
method of watermarking a video signal by applying a 
watermarking function to motion vectors calculated by 

15 motion estimation between images of the video signal, the 
method being of the type comprising the following steps: 

- applying the watermarking function to at least some 
of the calculated motion vectors; and 

— generating the watermarked video signal by motion 

2 0 compensation with the aid of the watermarked motion 

vectors , 

the watermarking function being applied with the aid of a 
binary marking key, each bit of which is associated with 
at least one selected motion vector. 

2 5 BACKGROUND OF THE INVENTION 

A method of the above kind is described in the paper 
by F. Jordan, M. Kutter, and T. Ebrahimi, "Proposal of a 
watermarking technique for hiding/retrieving data in 
compressed and decompressed video 1 ', ISO/IEC document 
30 JTC1/SC29/WG11/MPEG97/M2281, of July 1997. In that 

document, the watermarking function is applied with the 
aid of a marking key. This is a binary word of 16 or 32 
bits inserted into the motion vectors of the video 
signal, which motion vectors are obtained with the aid of 

3 5 an MPEG4 encoder. The number of motion vectors selected 

is the same as the number of bits in the marking key, 
i.e. 16 or 32 motion vectors are selected. Then, for 
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each of the vectors selected, the corresponding bit of 
the marking key is inserted into one of the components of 
the motion vector, for example the vertical component, 
modifying its parity. 
5 Unfortunately, that solution is not very robust, 

since the slightest attack can transform an even ordinate 
into an odd ordinate and vice-versa. Here, the term 
"attack" means malicious attacks and also non-malicious 
attacks such as compression or changing the spatial or 
10 the temporal format of the video signal. Moreover, by 

always modifying the same predetermined component of the 
selected motion vectors, for example the vertical 
component, that solution runs the risk of making the 
watermarking more visible in the video signal. 
15 OBJECTS AND SUMMARY OF THE INVENTION 

The invention aims to remedy those drawbacks by 
providing a robust method of watermarking a video signal 
that improves watermarking performance in terms of 
invisibility and in which the watermarking is carried by 
20 the motion vectors. 

To this end, the invention consists in a method of 
the above- specif ied type for watermarking a video signal, 
wherein, in order to apply the watermarking function, the 
method further comprises the following steps: 
25 - marking the coordinates of the selected motion 

vector in a space including a reference partition, 
certain portions of this space constituting a first 
zone and the other portions of this space 
constituting a second zone, complementary to the 
30 first; 

- assigning a binary value to each of the two zones; 
and 

- where necessary, modifying the coordinates of the 
selected motion vector so that it is in the zone 

35 whose binary value corresponds to the bit of the 

marking key with which the selected motion vector 
is associated. 
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With this approach, greater diversity in the 
modification of the selected motion vectors can be 
envisaged, which improves the quality of the watermarking 
in terms of invisibility. Robustness is also improved 
5 since the watermarking leads to modifying the components 
of the selected motion vectors by a geometrical 
transformation and not solely by a change of parity. 

A method of the invention may further comprise the 
feature whereby the reference partition is a reference 
10 grid comprising blocks with predefined dimensions, each 
block comprising a first zone and a second zone. 

A watermarking method of the invention optionally 
includes the following steps: 

— calculating a hierarchical plurality of successive 
15 levels of motion vectors, the motion vectors of a 

given level each being associated with a plurality 
of motion vectors of the next lower level; 

— selecting at least some of the motion vectors 
belonging to the highest level; 

20 - applying the watermarking function to each selected 

motion vector, leading to calculating a 
modification parameter for said motion vector; and 

— applying the modification parameter of the selected 
motion vector to the motion vectors of a lower 

25 level associated with said motion vector. 

The hierarchical approach of this method effectively 
increases the robustness of watermarking by judiciously 
spreading the marking key over a plurality of motion 
vectors, starting from a single selected motion vector. 

30 A method of the invention for watermarking a video 

signal may further comprise one or more of the following 
features : 

— the motion vectors of a given level are each equal 
to the average of the motion vectors of the next 

35 lower level with which they are associated; 

— it includes a step of calculating a hierarchy of 
two successive levels of motion vectors, each 
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motion vector of the higher level being associated 
with four motion vectors of the lower level; 

- the first and second zones have substantially equal 
areas ; 

5 — a sub-block centered inside the block is defined in 

each block of the reference grid, the first zone 
being defined by the interior of the sub-block and 
the second zone being the zone in the block 
complementary to the first zone; 
10 - the blocks and sub-blocks of the reference grid are 

rectangular; 

- the modification, if any, applied to the selected 
motion vector is a weighted symmetry; 

- the modification, if any, applied to the selected 
15 motion vector is either a weighted central symmetry 

relative to one of the vertices of the sub-block or 
a weighted axial symmetry relative to one of the 
sides of the sub-block; 

- each bit of the binary marking key is associated 
20 with a plurality of selected motion vectors; 

- some of the bits of the binary marking key are 
associated with motion vectors calculated by motion 
estimation between two images of the video signal, 
and at least some of the other portion bits of the 

25 binary marking key are associated with motion 

vectors calculated by motion estimation between at 
least two other images of the video signal. 
The invention also consists in a video signal 
watermarking device including means for implementing a 
30 method as described above. 

The invention further consists in a computer 
readable data medium including means for storing a video 
signal watermarked with the aid of a method as described 
above . 

35 The invention further consists in a method of 

extracting watermarking from a video signal watermarked 
by applying a method as described above, which extraction 
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method comprises applying a function for extracting the 
binary marking key, and consisting in: 

- selecting the watermarked vectors; 

- marking the coordinates of each watermarked motion 
5 vector in the reference grid; 

— assigning the binary value of the zone in which the 
watermarked vector is situated to the bit of the 
marking key with which the selected motion vector 
is associated. 

10 A method of extracting the watermarking from a video 

signal may further comprise, for each motion vector of 
the highest level selected on applying the watermarking 
method, the following steps : 

- extracting the watermarked motion vectors 
15 associated with said motion vector; 

— calculating an average vector equal to the average 
of the watermarked motion vectors associated with 
said motion vector; and 

— applying the marking key extraction function to the 
20 calculated average vector. 

Finally, the invention further consists in a device 
for extracting the watermarking from a video signal, 
which device includes means for implementing a 
watermarking extraction method as described above. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be better understood on reading 
the following description, which is given by way of 
example only and with reference to the accompanying 
drawings, in which: 

30 - Figure 1 shows the successive steps of a 

watermarking method of the invention; 

- Figure 2 is a reference grid used for applying a 
watermarking function of the invention; and 

- Figures 3, 4, 5, and 6 illustrate rules for 
3 5 applying the watermarking function. 

MORE DETAILED DESCRIPTION 
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The watermarking method shown in Figure 1 is 
implemented by conventional data processing means, for 
example a microcomputer that comprises a central 
processor unit (CPU) associated with random access memory 
5 (RAM) and read-only memory (ROM) . 

The watermarking method includes a first step 10 of 
motion estimation . 

During this step, a source video signal S is fed to 
the input of the microcomputer and a matrix 12 of motion 

10 vectors is associated with any image of the video signal 
S in the conventional way. This matrix of motion vectors 
is used to generate a prediction of the image concerned, 
for example starting with the preceding image of the 
video signal, by moving blocks of pixels thereof as a 

15 function of the calculated motion vectors. 

The motion vectors are calculated by applying a 
block matching method, for example. For each block of 
pixels of the image concerned, this method consists in 
evaluating the best motion vector for reconstructing the 

20 current block from a block of the same size in the 

preceding image displaced with the aid of the motion 
vector. To this end, a search is conducted around the 
current block in the preceding image in order to 
determine the motion vector that minimizes a standard 

25 Displaced Frame Difference (DFD) cost function, 

representing the difference between the displaced 
preceding image and the current block in the image 
concerned. 

The matrix 12 of motion vectors represented in this 
30 figure includes thirty-six motion vectors denoted Fij , 
with 1 < i < 9 and 1 < j < 4. Of course, the number of 
motion vectors is generally greater. Only thirty-six are 
shown to simplify the remainder of the description. 

Then, during a step 14, a higher level of motion 
35 vectors 16 is calculated. At this higher level, each 

motion vector is associated with four motion vectors of 
the lower level 12. In fact, the blocks corresponding to 
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each motion vector of the lower level 12 are grouped four 
at a time into macroblocks. The higher level therefore 
includes nine vectors denoted V x to V 9 . Each motion 

vector V i of the higher level is representative of a 

5 macroblock and is calculated in the following manner: 

Step 14 could be iterated several times, which would 
create a hierarchy of motion vector levels. This example 
is limited to one iteration, that is to say to two levels 

10 of motion vectors. 

Then, during a step 18, a set 20 of motion vectors 
is selected from the motion vector 16 of the higher level 
in a deterministic manner or in a pseudorandom manner on 
the basis of a secret key or on the basis of a mask. In 

15 this example, the set 20 of selected motion vectors 
comprises the vectors V 6 , V 5 , V 2 , and V 9 . 

During the watermarking step 22 that follows, the 
selected vectors 20 are modified by applying a 
watermarking function to them with the aid of a marking 
20 key W. The number of motion vectors 20 selected is 

directly related to the size of the marking key W. In 
this example, W is a binary word comprising four bits, 
which is why four motion vectors were selected in step 
18. 

25 Accordingly, during step 22, the parameters of the 

watermarking function are set to insert the first bit of 
the marking key W into the motion vector V 6 , the second 
bit into the motion vector V 5 , the third bit into the 
motion vector V 2 , and the fourth bit into the motion 

3 0 vector V 9 . 

The chosen watermarking function is described in 
more detail with reference to Figures 2 to 6 . However, 
generally speaking, it can be modeled by the following 
equation : 



in which SV { is a parameter depending on the chosen 
watermarking function and on the i th bit of the marking 
key W to be inserted. 

After this step 22, four new motion vectors V\ , V\ , 

V\ and V\ are obtained. As indicated above, these 
vectors satisfy the following equations: 



v\ = v 2 + sv 2 

10 V\ = + SVg 

During the next step 25, the watermarking function 
is applied to the motion vectors of the lower level that 
are associated with the selected vectors 20, using the 
parameters SV^ calculated during the preceding step. For 

15 example, the transformation SV^ applied to the motion 

vector V 6 is also applied to the corresponding vectors of 

the lower level, i.e. to the vectors V 6l , V 62 , V 63 , V 64 . 

Thus sixteen new motion vectors 26 are obtained at the 
lower level, satisfying the following equation: 

2 0 V/ e {6;5;2;9}, V/ e {l,2,3,4}F^ = V~. + SV t 

These sixteen new motion vectors replace the 
corresponding original vectors to furnish a new matrix 28 
of motion vectors. The new matrix 28 is used to obtain a 
watermarked version S' of the video signal S. 
25 In fact, during a last step 30, movement 

compensation is applied with the aid of this motion 
vector matrix 28, based on the image that was used as a 
reference for motion estimation during step 10, i.e. the 
image preceding the image concerned. 

3 0 Two methods can be envisaged for this step. 

A first method consists in compensating movement 
with the aid of all of the motion vectors of the matrix 
2 8 to obtain a watermarked version of the image 
concerned . 
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A second method consists in compensating movement 
only for the blocks corresponding to the motion vectors 
modified by the watermarking operation, leaving the other 
blocks of the image concerned unchanged, in order to 
5 improve image quality. 

The steps 10 to 30 described above can be iterated 
over several images of the video signal S. The 
redundancy obtained in this way increases the robustness 
of the watermarking. 

10 Watermarking redundancy can also be obtained by 

associating each bit of the marking key W with a 
plurality of selected motion vectors of the higher level. 

A watermarking method like that described above 
cannot be used in a encoding/decoding system. However, 

15 the modifications to be made to it so that it can be used 
in a encoding/decoding system, using motion analysis, 
will be evident to the person skilled in the art. In 
fact, video coding methods, such as methods using the 
MPEG2 standard or the MPEG4 standard, generate matrices 

20 of motion vectors to which the above-described method can 
be applied when encoding the video signal. 

It will be noted that step 14 is optional. Without 
applying this step, the selected motion vectors are the 
lower level motion vectors, and the less extensive 

25 spreading of the watermarking in the image can be 

compensated by selecting a plurality of motion vectors 
for each bit of the marking key. However, this has the 
effect of limiting the performance of the watermarking in 
terms of invisibility. In fact, one benefit of the 

3 0 hierarchical approach is applying the same deformation to 
adjoining motion vectors at the lower level. 

In one particular embodiment of the invention, the 
insertion of the marking key into the video signal S can 
be distributed over a plurality of pairs of images. In 

3 5 other words, in this case, only a portion of the marking 
key W is inserted into the selected motion vectors of a 
matrix of motion vectors calculated between two 
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successive images, after which the remainder of the 
marking key is inserted over one or more matrices of 
motion vectors calculated between other pairs of 
successive images of the video signal S. 
5 The watermarking function applied to the selected 

motion vectors 20 is described next with reference to 
Figures 2 to 6 . 

Application of the watermarking function uses a 
reference grid that is shown in Figure 2. This grid is 

10 placed in an orthogonal Cartesian system of axes (O, x, 

y) and is made up of blocks 4 0 with a dimension Kq in the 
abscissa direction and a dimension H 0 in the ordinate 
direction. In this example, Ko is equal to H 0 and has a 
value of seven pixels. 

15 A centered sub-block 42 with smaller dimensions is 

defined inside each block. In this example, the sub- 
block 42 has the dimensions Ki = Hi = five pixels. 

Two zones Z 0 and Z x are therefore defined within each 
block of the reference grid, the first zone Z 0 lying 

20 between the sub-block 42 and the block 40 and the zone Zi 
being the interior zone of the sub -block 42 . The 
dimensions K 0 , H 0 , K x and Hi are preferably chosen so that 
zones Z 0 and Z x have substantially the same area. In this 
example, the total area of each block 40 is 49 pixels, 

25 the area of zone Z x is 25 pixels and the area of zone Z 0 
is 24 pixels. 

Let ^(V x ,V y ) be a motion vector selected for 

applying the watermarking function with the aid of the 
marking key W. To be more precise, applying the 
30 watermarking function to the vector V consists in 

transforming the latter so that it carries information 
for determining the value of one of the bits of the 
marking key, for example the i th bit W ± . The resulting 
vector is denoted ^ (v' x , V' y ) . 

35 The watermarking function is defined by applying the 

following rules: 
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- if Wi = 0 and the point V with coordinates (V x/ V y ) 
in (O, x, y) is in zone Z 0 , then V % = V ; 

- if Wi = 0 and the point V with coordinates (V x# V y ) 
in (0, x, y) is in zone Zi, then V is subjected to 

5 a transformation so that the point V 1 with 

coordinates (V' x , V' y ) in (O, x, y) is in zone Z 0 
(this transformation is described in detail with 
reference to Figure 3); 

- if Wi = 1 and the point V with coordinates (V x/ V y ) 
10 in (O, x, y) is in zone Zi, then V 1 = V ; 

- if Wi = 1 and the point V with coordinates (V x , V y ) 
in (O, x, y) is in zone Z 0 , then V is subjected to 
a transformation so that the point V with 
coordinates (V f x/ V' y ) in (O, x, y) is in zone Zi 

15 (this transformation is described in detail with 

reference to Figures 4, 5 and 6) . 

Figure 3 illustrates the situation in which Wi = 0 
and the point V is in zone Z lf in other words inside the 
sub-block 42 whose vertices are denoted A, B, C and D. 

20 The vertex closest to V is determined, here the 

point A, and then weighted central symmetry with respect 
to the center A is applied to displace the point V to V 
in zone Z 0 . Of course, the weighting parameter is 
calculated so that V is always in zone Z 0 . For example, 

25 given the dimensions of the blocks 40 and 42, the 
weighted central symmetry is defined here by the 
following equation : 

AV' - - - AV . 
5 

If Wi = 1 and V is in zone Z 0 , then V is obtained 
30 by applying weighted axial symmetry whose axis is the 
side of the sub-block 42 nearest the point V, if that 
transformation yields a point V in zone Z x . This is the 
situation shown in Figures 4 and 5. 

In this case, if H denotes the projection of V onto 
35 the axis concerned, and with the dimensions chosen for 
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this example, the weighted axial symmetry is defined by 
the following equation: 

~HV< = - — ~HV . 
2 

In the other situations represented in Figure 6, 
5 that is to say if the image of the point V obtained by 
axial symmetry as described above does not yield any 
point V in zone Z lf a weighted central symmetry is 
applied to the point V whose center is the nearest vertex 
A, B, C, or D. In the Figure 6 example, this is the 
10 point A. Here the equation 

AV' = - - AV 
2 

defines the weighted central symmetry. This situation 

arises when the point V is in the vicinity of one vertex 

of the block 40. 
15 It is possible to detect and extract the mark 

inserted into a video signal using the watermarking 

method described above. 

The mark detection and extraction method comprises 

applying a function for extracting the binary marking key 
20 W, and consisting in: 

— selecting the watermarked vectors; 

- marking the coordinates of each watermarked motion 
vector in the reference grid; and 

— assigning the binary value of the zone in which the 
25 watermarked vector is situated to the bit of the 

marking key with which the selected motion vector 
is associated. 

To be more precise, if step 14 has been executed 
during the watermarking of the video signal, for each 
30 motion vector 20 of the highest level 16 selected during 
applying the watermarking method: 

- the watermarked motion vectors associated with that 
motion vector are extracted; 
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- an average vector is calculated equal to the 
average of the watermarked motion vectors 2 6 
associated with that motion vector; and 

- the function for extracting the marking key 
5 described above is applied to the calculated 

average vector. 

This extraction method can extract an estimate 
W = (w x , W 2 , W 3 , W 4 ) of the marking key W =(W i# W 2 , W 3/ W 4 ) 

from a watermarked image of the video signal . 
10 Once the marking key has been extracted, a 

correlation score is used to determine a+ 

confidence threshold characterizing the presence or 
the absence of the marking key in the video signal. 

A first correlation rule for estimating whether the 
15 marking key is present or not in an image is given by the 
following formula : 

c= '-' _ 

in which: 

— 1 4 _ 1 4 

w = ~Yu w i and w=~Yu w i • 

20 A second correlation rule for estimating the 

presence of the marking key in a plurality of images I ! n 
of the signal S' is given by the following recurrent 
formula : 

c„_, .( n -.) + (i-4^>) 

C n — 

n 

25 in which d(w n ,w) is the Hamming distance. 

It is clear that a watermarking method of the 
invention improves the robustness and the performance in 
terms of invisibility of the existing methods. 

In fact, the watermarking function, which aims to 
30 place a motion vector in a zone Z ± or Z 0 as a function of 
the value of the bit of the marking key to be inserted, 
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effects watermarking of the video signal that is hardly- 
visible . 

Another advantage of a watermarking method of the 
invention lies in the hierarchical approach described 
above with respect to step 14 in particular of the above- 
described method. Spreading the watermarking over a 
plurality of motion vectors of a lower hierarchical level 
based on the selection of a corresponding motion vector 
from a higher hierarchical level reduces the effect of an 
attack on the watermarking of the video signal, whether 
malicious or not. 



